"mask-bot" - a life-size talking head animated robot for AV speech and human-robot communication research
نویسندگان
چکیده
In this paper we introduce our life-size talking head robotic system, Mask-bot, developed to support human-robot communication research. The physical system consists of a semitransparent face mask, a portable LED projector with a fish-eye conversion lens, a pan-tilt unit and a mounting base. Mask-bot uses the mask as a screen for a talking head animation engine that is broadcast from the projector mounted behind the mask. Via this process the head becomes a life-size talking head in real space as opposed to 2D flat screen space or stereo pseudo-3D screen space, affording the means for testing new face models for AV speech synthesis and perception in life-size output without building an actual robotic head.
منابع مشابه
"Mask-bot": A life-size robot head using talking head animation for human-robot communication
In this paper, we introduce our life-size talking head robotic system, “Mask-bot”, developed as a platform to support and accelerate human-robot communication research. The “Mask-bot” hardware consists of a semi-transparent plain mask, a portable LED projector with a fish-eye conversion lens mounted behind the mask, a pan-tilt unit and a mounting base. The hardware is driven by a software anima...
متن کامل"Mask-Bot 2i": An active customisable robotic head with interchangeable face
This paper describes the development of “MaskBot 2i” (codenamed: Kabuto), a robotic head designed for research into Human-Robot-Interactions. The uniqueness of our new robotic head is that the appearance of its face can be alter on-the-fly. Different faces can be projected onto the active head system. The head is fully active with a 3-DOF neck, with support for biannual hearing as well as video...
متن کاملEvaluation of synthetic and natural Mandarin visual speech: Initial consonants, single vowels, and syllables
Although the auditory aspects of Mandarin speech are relatively more heavily-researched and well-known in the field, this study addresses its visual aspects by examining the perception of both Mandarin natural and synthetic visual speech. In perceptual experiments, the synthetic visual speech of a computer-animated Mandarin talking head was evaluated and subsequently improved. Also, the basic (...
متن کاملThe furhat social companion talking head
In this demonstrator we present the Furhat robot head. Furhat is a highly human-like robot head in terms of dynamics, thanks to its use of back-projected facial animation. Furhat also takes advantage of a complex and advanced dialogue toolkits designed to facilitate rich and fluent multimodal multiparty human-machine situated and spoken dialogue. The demonstrator will present a social dialogue ...
متن کاملRoles of a Talking Head in a Cooperative Human-Robot Dialogue System
The JAST human-robot dialogue system [1] is designed as a platform to integrate empirical findings on cognition and cooperative dialogue with research on autonomous robots by supporting multimodal human-robot collaboration on a construction task. The robot consists of a pair of mechanical arms with grippers, mounted in a position to resemble human arms, and a Philips iCat animatronic talking he...
متن کامل